Search AI Products and News

Recently, the Internet Watch Foundation (IWF) issued a warning that the appearance of AI-generated Child Sexual Abuse Material (CSAM) has become increasingly frequent on the open web, reaching a 'critical point'. The safety oversight body stated that in the past six months, the quantity of illegal content created by AI they have discovered has already surpassed the total from the previous year. Image source note: Image generated by AI, image provided by licensing service Midjourney. IWF's interim CEO Derek Ray Hill.

The police in New Mexico, USA, used AI-generated images of a virtual 14-year-old girl to lure sexual offenders, aiming to investigate the protection of children from sexual exploitation on the Snapchat platform. This method has sparked discussions on ethics, legality, and AI ethics, particularly regarding the legality of AI-generated images, privacy rights, and consent issues. Legal experts point out that creating and using deepfake child sexual abuse material is illegal and concerning. Moreover, the requirement for real children's images as training datasets for AI-generated images raises concerns about children.

LAION launched Re-LAION-5B, the world's first AI training dataset that fully removes links to CSAM, aimed at addressing the issue of Child Sexual Abuse Material (CSAM). This dataset has been significantly improved over LAION-5B and is mainly divided into two versions: Re-LAION-5B Research and Research-Safe. A total of 2,236 CSAM links have been removed, including 1,008 from child protection organizations' lists. The dataset contains 5.5 billion pairs of text and images, designed to help

A report from Anglia Ruskin University reveals a rapid increase in demand for AI-generated child sexual abuse images on the dark web. Researchers Dr. Deanna Davy and Professor Sam Lundrigan analyzed chat logs from dark web forums over the past 12 months and found that online criminals' interest in using AI technology to create child pornography materials is rising. They are self-learning and sharing experiences to create AI-generated abusive images online. The study points out that the problem posed by AI technology is that law enforcement agencies face significant challenges in understanding and responding to AI-generated materials.

The AI technology developed by Stanford psychologist Mikhail Kosinski can accurately determine IQ, sexual orientation, and political leanings by scanning faces, with accuracy rates of 72%, 91%, and 72%, respectively. This study has sparked ethical controversies and potential misuse, such as discrimination against the LGBTQ+ community. The use of facial recognition technology has already led to privacy breaches and violations of civic liberties, highlighting the importance of protecting privacy rights and civil freedoms. Kosinski's research not only warns of the potential dangers of facial recognition technology but also reveals the negative implications it may bring.

Students are using artificial intelligence to create images suspected of child sexual abuse, with a shocking level of realism. Experts are calling for urgent action, suggesting schools stop the dissemination of child sexual abuse materials. The quality of the images is comparable to professional children's photographs, and the realistic portrayal of children could be spread across the internet. Child protection organizations recommend the establishment of better systems to prevent such harmful behavior.

The Internet Watch Foundation (IWF) warns that the issue of child sexual abuse images may worsen. The report calls for the government and technology providers to swiftly control the artificial intelligence that generates deepfake images. Generative AI systems could lead to virtual child deepfakes, expanding the potential victim pool. Strengthening legal responses to AI-generated abuse, particularly with recommendations aimed at the EU.

A pediatric psychiatrist in North Carolina has been sentenced to prison for producing, possessing, and distributing child sexual abuse material (CSAM). Psychiatrist David Tatum was charged for secretly recording patients using artificial intelligence software to create illegal images and videos. Prosecutors stated that the psychiatrist's actions harmed children, resulting in a 40-year prison sentence and 30 years of supervised release.